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ABSTBACT 

A planning aodel incorporating the concepts of 
Planning, Prograaaing, and Budgeting Systeas (PPBS) vas developed in 
the Ouluth, Binnesota public school systea to assist in the 
consolida-*-lon of federally funded prograas in the district, 
especially those under the Eleaentary and Secondary Bdacation Act 
(BSEA) Title III. A cost effectiveness aodel for prograa review and 
evaluation is described, and the procedures for deteraining costs and 
aeasures of student progress in various doaains are presented. 
Bzaaples of the analytical flow of the aodel together with exaaples 
of the worksheets used for the analysis are provided. (OGQ 
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MAMAGEMEWT TECHNIQUES APPLIED TO 

THE DEVELOPMENT OF A PLANNING MODEL 

FOR EDUCATIONAL PROGRAMS 

CULUTH CONSOLIDATED GRANTS AND PROGRAM MANAGEMENT PROJECT 

E.S.E.A. TITLE III 
DEPARTMENT OF PLANNING AND EVALUATION 
OULUTH PUBLIC SCHOOLS 
DULUTH, MINNESOTA 

I. INTRODUCTION 

During the Spring of 1973 the Ouluth Public School Systea wis award- 
ed a Title III, E.S.E.A. grant to assist in the consolidation of 
Federally funded programs. The desire for consolidation led to the 
need for a management information system t«hich could: 

1. ) Assist in the coordination of planning efforts 

directed at developing a consolidated funding 
proposal. 

2. ) Assist in managing the iiq»lementation of the 

consolidated programs funded. 

3. ) Standardize the information flow bet%#een pro- 

gram planning and program implementation 
activities for the purpose of developing 
educational and cost-effectiveness measures. 
This paper describes the management techniques used to develop the 
planning model for consolidating the funding of Federal programs* 
The initial application of the model was limited. Since that time 
it has experienced wider use by the Duluth Public Schools and the 
Minnesota state Department of Education. 
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The initial step in developing the planning model was the identifi- 
cation of data components i.e., needs assessment, educational object- 
ives, program description, resource specification, budget specifi- 
cation and evaluation design. After the components had been identi- 
fied the informational makeup of each con^wnent was specified. A 
review of the literature produced by State education Agencies in- 
volved in the Interstate CoGraM Project begun in 1972 and a review 
of other educational management systems helped establish the com- 
ponents as well as the informational makeup of each component. 

Once the components and their make-up had been established it was 
necessary to determine: 

1. ) The sequence of data components within the 

model. 

2. ) The sequence of activities for the collection, 

treatment and reporting of data both within 
and between components. 

3. ) A schedule by %^ich the planning effort would 

be facilitated. 

The needs just identified %#ere not resolved in the initial reviews. 
Further review (Hartley, 1968 and 1972; Cook, 1967) provided the 
desired input on technique. This made possible the finalization 
of the model portrayed in Figure 4 of the Appendix. 

Sequencing and scheduling the flow of information within i:he modr.l 
was accomplished with the following techniques; 

Dependency Network ( iii>orkbreakdovm structure ) - A technique 
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%tfhlch combines system analytic and synthesizing procedures 
with the flow-graph concept of nodes and branches. The 
resulting network which Is graphically Illustrated provides 
a sequence and relationship bet%^n component tasks, events 
and/or products %#hlch can be used for scheduling purposes. 
Flow Grap h Methodol ogy ( "flow charts" ) The technique of 
displaying graphically the operations that a system performs 
upon the Information It processes. 

System A nalysis - The process of breaking down a system 
Into Its primary components (subsystems) for the purpose 
of moi-e clearly defining each component In terms of the 
tasks, activities, events and products required for ful- 
fillment. 

System S ynthesis - The process of examining the defined 
characteristics of each component of the system in terms 
of tasks, activities, events and products for the purpose 
of providing a logical and orderly relationship between 
the components (subsystems) of the system. 

II. APPLICATION OF THE MANAGEMENT TECHNIQUES 

This section of the paper explains in a step by step manner how 
management techniques were applied in finalizing the planning 
model. Reference is made to the Appendix trtiich contains an ex- 
ample of the product obtained in each step. 

Step 1; A planning sequence was hypothesized for the 
purpose of doing systems analysis. Please note Figure 
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1 in the Appendix. 

Step 2; Systems analysis was applied to each component 
of the hypothesized planning sequence. This analysis 
identified: I.) activities needed to collect, treat 
and report data within each conponent 2.) the person 
responsible for the completion of each activity. 3.) 
the resources required for activity completion 4.) the 
product resulting from the activity and 5.) the critical 
date for completion of the activity. Please note Figure 

2 of the Appendix. The reader should realize that the 
activity sequence and critical date %^re finalized 
after completion of the %K>rkhreakdown structure. 

Step 3 ; Plow charts for each component were developed 
from the activities identified through systems analysis. 
This was the first step in synthesizing the system. 
These flows were initially treated as tentative. Their 
validity was proven upon incorporation into the work* 
breakdovm structure. Please note the flow chart dis* 
played in Figure 3 of the Appendix. 

Step 4 ; This step involved finali.zing the sequence of 
activities in each component and determining the points 
of interface between components. This was the second 
phase of systems synthesis and resulted in the workbreak- 
down structure. 

A final sequence vas accomplished by first typing each 
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of the identified component activities onto a slip of 
paper. Each activity slip was color coded. Color 
coding was based on the original assignment made in 
Step 3. The activity slips were grouped by component 
and placed in the sequence previously established. Each 
activity was re*examined in terms of the information 
required for its completion and its informational output 
for that component. Each activity was also examined 
as toi^ether it required information from or produced 
information needed in another component. Those activities 
relating to other components became points of interface 
between components. 

The information flows established within and between 
components provided the base for finalizing the activity 
sequence within each component and the component sequence 
within the model. The time schedule for program planning 
was established at this time. The irorkbreakdown structure 
produced by this step is not included in the Appendix be* 
cause of the difficulty experienced in its reproduction. 
Step 5 ; A summarization of the component interfaces 
established when developing the workbreakdown structure 
provided the basis for the final design of the planning 
model. This model is Figure 4 in the Appendix. 
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III. SUMMARY 

The final design of this planning rriodel reflects three sGfurces of 
input. These include: 1.) the use of management techniques in its 
development 2.) the keynote nature of student needs assessment data 
and 3.) constructs associated with P.P.B.S. 

Application of management techniques served to specify intra and 
inter component structures. The techniques facilitated the inte- 
gration of the component into a system and helped establish a 
schedule for its application. 

The importance of communicating student data to all decision makers 
involved in the planning process was based on an inherent danger 
which exists among planners. Systems analysis and synthesis , 
P.P.B.S.y and management information systems are used by personnel 
removed from the instructional process. The tendency can exist to 
process administrative functions with disregard for the available 
student data. The design of this planning model stresses the need 
to consider the relationship of current student data to the data 
of the other components. 

The rationale for including P.P.B.S. constructs is best stated by 
Hartley, 1972: 

••In competing for public funds educators 
are now being challenged to justify their 
budgetary requests in terms of student 
achievement rather than with costs of 
objects and services^^. 
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This rationale hes been adopted by the Duluth Public Schools. This 
fact enJ the advantages provided by P.P.B.S. constructs for program 
evaluation led to their inclusion in the planning model. 

Application of the planning model resulted in the use of consistent 
measures of student progress during the needs assessment, monitoring 
and evaluation processes. These measures combined with the cost 
dat? obtained by applying P.P.B.S. constructs made it possible to 
produce a useable data base for determining measures of cost- 
effectiveness. The cost-effectiveness model which serves as a 
base for applying these measures is explained in the second part 
of this paper. 
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MANAGEMENT TECHNIQUES USED IN EDUCATIONAL 
PROGRAM PLANMNG MODEL 
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RESULTS OP SYSTEMS ANALYSIS 

1.0 Analysis of student needs assessment process in terms of major 
responsibility, resources required, product and date of completion. 

1.01 Identification of student needs assessment information required 
by funding agencies completed. 

A. Major responsibility: Director of Planning and Evaluation 

B. Resource requirements: 

1. Time of administrative personnel - central office 

2. Secretarial time 

3. Office supplies 

C. Product: Source document indicating specific information 
. required in terms of funding guidelines 

D. Date of completion: 1-21-74 

1.02 Development of criterion and method of analysis for examination 
of student needs completed. 

A. Major responsibility: Director of Planning and Evaluation 

B. Resource requirement: 

1. Time of administrative personnel - central office 
and building 

2. Time of instructional personnel 

3. Secretarial time 

4. Office supplies 
€• Product: 

1. Designation of measurement instruments 



Figure 2 
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PART 2 



A COST-EFFECTIVENESS MODEL FOR EDUCATIONAL PROGRAMS 



DULUTH CONSOLIDATED GRANTS AND PROGRAM MANAGEMENT PROJECT 

E.S.E.A. TITLE III 
DEPARTMENT OF PLANNING AND EVALUATION 
DULUTH PUBLIC SCHOOLS 
DULUTH, MINNESOTA 
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A cost-effex:tiveness model for educational prcxsrams 

DULUTH CONSOLIDATED GRANTS AND PROGRAM MANAGEMENT PROJECT 

E.S.E.A. TITLE III 
DEPARTMENT OP PLANNING AND EVALUATION 
DULUTH PUBLIC SCHOOLS 
DULUTH, MINNESOTA 

I. INTRODUCTION 

The initial intent of this management system was to coordinate the 
use of educational resources provided by more than one categorical 
aid. This led to a need for measures of effectiveness which %rauld 
assist in determining whether or not coordination improved the 
capabilities of the affected programs to meet the identified needs 
of children. A second and even more pressing purpose for deter- 
mining effectiveness was based upon the need for improving the 
allocation of educational resources in light of the recent finan- 
cial crunch faring education. 

Initial Project efforts centered on the development and implement- 
ation of a student information base to assist in the management of 
E.S.E.A. Title Programs. This base was and is being used to deter- 
mine the educational effectiveness of these programs. 

The stated concern regarding the ability of this management system 
to affect instructional decisions and in turn improve student per- 
formance resulted in a decision to expand upon the measures of 
effectiveness within the system. This decision resulted in a review 
of the literature relating to cost-effectiveness. 
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The review provided considerable assistance in helping isolate and 
define numerous variables that would have to be dealt with in de- 
veloping a cost-effectiveness model. It also exposed some weak- 
nessess that needed correction before a meaningful data base could 
be established for comparing cost changes incurred when altering 
the mix of resources to a*:tain a specific educational objective. 

The patterns of weakness most evident as a result of the review 
were: 

1. The use of gross measures as indicators of educational 
effectiveness, i.e., student hours or quantity of 
students served. 

2. Inability of numerous models to define the value 
added resulting from the instructional process. 

3. Failure to carry out process and task analysis, i.e., 
specify the production function for the purpose of 
refining the analysis of costs. 

4. Failure to apply those economic constructs necessary 
for a meaningful determination of opportunity cost. 

Points 1 and 2 above were resolved as a result of the Project's 
initial efforts in defining a student information bf.se. Research 
and the application of this research provided a more exact measure 
of student progress within the programs under analysis. The use 
of consistent measures during the needs assessment, monitoring and 
evaluation processes provided a consistency necessary for deter- 
mining value added. 

Points 3 and 4 identified as a result of the literature review 
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denoted the need for an improved cost data base which could be 
used in combination with the student data base to provide cost- 
effectiveness measures. The remainder of this paper will center 
on the constructs and relationships adopted for use in determining 
the desired cost data, output-input relationships and output-cost 
relationships needed to determine educational program cost-effectiv- 
eness* 

The following terminology will be used throughout this report. 

Average cost - Total cost divided by total output. Average outlay 

cost does not include the cost of missed opportunity. 

Downward Sloping Demand - The number of consumers for a product 

remains relatively constant with increases or decreases in product 

cost. 

Fixed cost - A cost that does not vary with output. 

Full cost (Total cost) - Variable costs + Fixed costs + Opportunity 

cost* 

Least Cost Principle ( Law of Diminishing Returns ) ( Law of Variable 
Proportions ) - At e certain point in a production function the add- 
ition of one additional unit of a variable resource to a set of 
fixed resources will cause a decline in output. 

Long Run • That period of time during which all costs are variable. 
Marginal cost - The increase in total cost divided by the increase 
in output. 

Natural Monopoly - A market situation in which a vitally important 
product is provided by one firm because competition would be waste- 
ful. 

Opportunity cost - Cost defined as a missed opportunity; a poten- 
tial for well being not achieved. 
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Out Cost - A cost that does not include the cost of missed 
opportunity* 

Output-cost relationship - Total output divided by total outlay 
cost for the purpose of determining average outlay cost* 
Output-input relationship • Total output divided by the total amount 
of a specific input expended in its production for the purpose of 
determining the average output per unit of that input expended* 
Production function - The relationship between the inputs (resources) 
and outputs of an instructional program* It is a flow of inputs 
resulting in a flow of outputs during some period of time* 
Short Run - That period of time during which costs are either fixed 
or variable* 

Variable cost - A cost that varies with output* 
II Assumptions 

Prior to the development and application of the model a number of 
assumptions were made to solidify the applicability of those con- 
structs and relationships in the model* Each assumption related to 
one of the following areas of concern: 1*) Inputs (student) 2*) 
Inputs (resource) 3*) The production function 4*) Outputs (student 
progress) 5*) Cost analysis and 6*) Output-input and output-cost 
relationships* Inputs (student) and outputs (student progress) 
relate to measures of educational effectiveness* This area of con- 
cern is addressed in this section of the paper but has not been ex- 
panded upon in Section III which describes the model* A definition 
of the educational effectiveness measures incorporated into this 
model can be found in a paper presented by Roger M* Giroux at the 
American Educational Research Association Annual Meeting of 1975* 
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The assumptions of this model by area of concern are: 

1. ) Inputs (student) 

a«) The inputs (student) are measurable and can be quantified. 

b. ) The inputs (student) are defined at the beginning of the 

program year through a needs assessment process. 

c. ) Educational programs relate to a downward sloping (less 

than elastic) demand, i.e., State statutes require 
school attendance through the age of sixteen (16), the 
lack of a substitute product exists and, in certain cases, 
guidelines provided by the State Department of Education 
specify those eligible for inclusion in the program. 

2. ) Inputs (resource) 

a. ) The identified inputs (resource are"real" inputs to 

tasks and processes of the program under analysis. 

b. ) The inputs (resource) required for carrying on the defined 

processes can be identified at the beginning of the pro- 
gram year, are measurable and can be quantified. 

c. ) Each identified unit of input (resource) will initially 

ba considered homogeneous. (PurLher study is needed to 
refine the criteria for clarifying this issue.) 
3-) Production function 

a. ) Educational programs exist as non-profit production 

units. 

b. ) Though education programs are analogous to natural 

monopolies the shapes (curvatures) of their production 
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functions and cost curves are similar to non-monopol- 
istic and monopolistic profit seeking organizations 
because the factors of production (resources) they 
purchase are obtained in the same resource markets 
and must be combined into a productive resource mix. 
C. Educational programs have defined processes for prod- 
ucing output and these processes can be defined through 
task analysis. 

4. ) Output (student progress) 

a. ) The unit of output for an educational program is the 

changed behavior of the child and this can be deter- 
mined by combining those indicators which are appro- 
priate indices of behavior change in terms of program 
goals and objectives. 

b. ) The output of an educational program can be quantified. 

c. ) The unit of output is defined at the beginning of the 

program year. 

5. ) Cost analysis 

a. ) Costs of educational programs are currently defined as 

outlay costs rather than full costs, i.e., do not 
include opportunity cost or normal profit. 

b. ) The costs of educational resources can be identified 

as fixed or variable. 

c. ) The costs of educational programs can be identified 

in the short run (where costs are fixed or variable) 
and the long run (where all costs become variable). 

6. ) Output-input and output-cost relationships. 
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a. ) The relationships between Inputs (resources) and outputs 

(student progress) have been defined at the beginning 
of the program year. 

b. ) Educational programs exist as natural monopolies within 

a specific geographical area (that area served by the 
school district) and there is flexibility in costing 
program output within the parameters of an approved 
budget . 

c. ) The process for determining marginal cost applicable 

to natural monopolies is also applicable to educational 
programs, i.e., educational programs exist as natural 
monopolies and are non-profit (cognizant of outlay as 
opposed to full costs). 
The assumption categories, i.e., Inputs (resource), production 
function, cost analysis and output-input and output-cost relation- 
ships reflect the order in which constructs and relationships were 
Incorporated into this model. The production function, ccst analy- 
sis and economic constructs used and their sequential relationship 
in the model were verified by each of the following references: 
Heilbroner, 1970; McCor.nell, 1972; Samueison, 1973; Spencer, 1974; 
and Watson, 1963. 



III. THE MODEL 

A. Inputs (Resource) 



Initial efforts in developing this model required a base for doing 
cost analysis. The first step Involved the identification of the 
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resources specified in step four of the planning process for each 
program by school building. Further analysis identified those 
resources allocated to each building by program component. Goals 
and objectives had been developed for each component. The components 
of a Title I, E-S.E.A. Program in Minnesota are reading, mathe- 
matics, behavior and adjustment and work habits^ 

Once this analysis had taken place the identified resources were 
quantified in terms of the building program and also by building 
program component. The majority of resources identified and 
quantified in this process were: administrative and instructional 
staff time, units of instructional materials expended and units of 
instructional equipment. All but the school i?ullding principal's 
time was purchased with Title I, E.S.E.A. funds. Building space 
was not included as a resource because the rooms woui<] have been 
vacant had they not been used for the program under analysis. 

3. Production Function 

The second step in determining a base for doing cost analysis re- 
quired that a task analysis ba done. This necessitated an exam* 
ination of the instructional process by building program component 
aimed at producing the identified unit of output. The identified 
tasks were sequenced and related to planning, implementation 
(instruction) or evaluation activities. Resources were assigned 
each task by program component and quantified in terms of planning, 
implementation or evaluation activity. The mix of resources identi* 
fiod for each progrcim component varied from building to building. 
This variance reflected the results of the needs assessment process 
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(step 1 of the planning procedure). Because needs varied between 
buildings the output units for each building were different and 
required a different process for attainment. The use of resource 
identification and quantification procedures and tasks analysis 
procedures provided an improved base for doing cost analysis. 

C. Cost Analysis 

The procedures applied up to this point established a base for the 
analysis and quantification of resource units i.equired to produce 
a specific type of output unit. Once resource quantification had 
taken place costs were assigned. 

The consumption of certain inputs (resources) varied during the pro 
gram year, i.e., instructional materials and equipment. The costs 
associated with these inputs were identified as variable. Other 
inputs remained constant during the program year, (i.e., admini- 
strative and instructional staff time.) The costs of these inputs 
were fixed. Both types of costs were classified as outlay rather 
than full cost, i.e., did not include op()ortunity cost. The ration 
ale for this assignment was based upon the fact that during the 
initial application of this model a cost base did not exist for 
making knowledgeable trade offs between resources applied to pro- 
duce a specific type of output unit as opposed to some other out-- 
put unit. 

At this point it was possible to determine total outlay costs ex- 
pended to produce an output unit. Total outlay cost was: 

T.O.C. = Variable outlay cost + Fixed outlay cost 
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The current Intent is to apply this equality during a given program 
year to various instructional processes aimed at producing a parti- • 
cular output unit. This application will provide iit!rtial cost data 
fci determining how cost effective these instructional processes are 
when directed at a particular output unit. 

The same equality will also be applied to a given instructional pro- 
cess aimed at a specific output unit over a number of program years* 
As the number of specific input units applied to this process change 
a base is established for determining marginal cost, i.e., the in- 
crease in cost when one additional unit of a specific input unit 
(resource) is applied to the instructional process. A longitudinal 
study applying the equality (T.O.C. = F.O.C. + V.O.C.) and the con- 
cept of mariginal cost should provide two benefits. These are: 

1. Provid.3 educational decision makers a bosis for 
distinguishing between the short run where costs 
are fixed and variable and the long run where all 
costs become variable. 

2. Establish a cost data base which will eventually 
make it possible to apply the "Least Cost Principle" 
and the opportunity cost concept to instructional 
programs . 

Staff costs make up a major portion of most program budgets. The 
affect of years of experience and number of degrees or credits earn- 
ed on staff salaries made it necessary to establish an average 
compensation figure for program staff. 
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This was done using the follcwin9 eqiuicion: 

Total program costs by building 
Incurred for a particular type 

of staff member Average compensation 

= figure for a position 

by building 

Total number by building 
of a particular type of 
staff member In the 
program 

This equation Is consistent with the assumption related to the homo 
genelty of specific Inputs. 



Inflation and/or recession will also affect program costs. A long- 
itudinal study of cost effectiveness will assist in the definition 
of a base period. This will inakc it possible to assess cost data 
not only on a current basis but in tenrs of a base which negates 
the effects of chese economic conditions. 



D. Output-Input and Output-Cost Relationships 



The completion of the procedures related to input (resource) analysis 
and quantification by building program and program component re- 
sulted in an information base for deterrring output-inpi-:!: relation- 
ships. Using the appropriate output unit by buildincj program or 
building program component in conjunction with the appropriate input 
(resource) the followlnu rclatxonshipii weie determined: 
Total units of output 

for building X Av^^rage unit of output 

= for building X per unit 

of a specific input 

Total units of a specific 
input for buiJding X 

and 



Total units of output 
by program component 

for building X Average output unit 

. ^= (component measure) for 

building X per unit 
Total units of a specific of a specific input 

input expended in that 
component 

Use of the data derived by applying the first relationship served 
as a base for determining the effect of using a certain quantity 
of a specific input to obtain a given building's output unit. The 
second relationship shows the effect of said quantity of inputs 
on the improvement of specific skills or attitudes. By computing 
these relationships over a number of years a data base can be 
established for determining the effect created on building or pro- 
gram component outputs as the quantity of specific input units 
are changed. 



Completion of cost analysis procedures made possible the following 
relationships: 

Total outlay costs 
for the program 
at building X 



Total output units 
prodacec^ at building X 
at program years end 

and 

Total outlay costs by 
a program component at 
building X 

=- Average outlay cont per 

uijit of program component 
Total output units (skills output ror building X 

mastered) produced at 
building X for that program 
component at year's end 



Average outlay cost per 
unit of output for 
building X 
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During the application of the model it was impossible to quantify 
inputs in terms of a coirjnon unit. This resulted in the analysis 
of the output-input data by type of input. Cost analysis trans- 
ferred all inputs into a common unit (dollars.) This made it 
possible to analyze the effect of combined inputs (resource mix) 
on each output unit by building and by building program component. 

The model is currently being used to determine total outlay and 
average outlay costs. Full costs (total costs) and average total 
costs will hopefully become reality at some time in the future. A 
cost data base must first be established which will improve our 
measure of the full cost incurred by alternate uses of a particular 
resource . 
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